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ABSTRACT 



A first nonlinear conversion section converts input color 
signals of a kind that is one of plural, different kinds to 
L*a*b* signals. A second nonlinear conversion section 
converts the L*a*b* signals to image recording signals of 
four colors including black. Tbe first nonUnear conversion 
section includes an input judgment device for judging the 
kind of input color signals, a weight memory for storing 
weights for the respective kinds of color signals, and a 
nonlinear conversion circuit Tlie weights corresponding to 
the kind of input color signals identified by the input 
judgment device are read from the weight memoiy and set 
in the nonlinear conversion circuit The first nonlinear 
conversion section further has a learning device to accom- 
modate color signals whose conversion relationship with the 
L*a*b* signals has not been defined. 

15 Claims, 10 Drawing Sheets 
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FIG. % 



Step. 1 PREPARE C, M, Y, K ^ L*a*b* CONVERSION PAIRS. 



Step. 2 PERFORM LEARNING ON C, M. Y. K -» L*a*b* CONVERSION 
USING CIE L*a*b* 4E AS ENERGY FUNCTION. 



Step. 3 PERFORM LEARNING ON L*a*b* — Kmax CONVERSION 

USING A SUBSET (AT LEAST ONE OF C, M AND Y IS 0) 
OF C,M.Y.K^L*a*b* CONVERSION PAIRS. 



Step. 4 CALCULATE UCR RATIO a BASED ON Kmax OF STEP 3 
AND K OF CONVERSION PAIR, AND OBTAIN L*a*b*a-» 
C,M,Y,K CONVERSION PAIRS. 



Step. 5 PERFORM LEARNING BASED ON L*a*b*a— C. M. Y, K 

CONVERSION PAIRS, AND SET RESULTING WEIGHTS AND 
THRESHOLDS AS OPTIMUM VALUES OF NONLINEAR 
CONVERSION CIRCUIT 7. 



FIG. 15 



Step. 1 READ REFERENCE DATA OF Di,D2. D3.D4 
L*a*b* CONVERSION. 



Step. 2 PERFORM LEARNING ON Di, D2.D3.D4 — 

L*a*b* CONVERSION USING CIE L*a*b* AE 
AS ENERGY FUNCTION. 
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COLOR IMAGE PROCESSING 

This applicatioD is a continuation of application Scr. No. 
08/37 L574, filed Jan. 12, 1995, now abandoned which was 
a continuation of application Sen No. 08/138,446 filed Oct 
20, 1993, now abandoned. 

BACKGROUND OF THE BSfVENnON 

The present invention relates to a color image processing 
method and apparatus for converting three color signals 
received from a color image input device or a color image 
generation device to color image recording signals of four 
colors including black. More specifically, the invention 
relates to a color image processing method and ^paratus for 
producing a desired print output from various tj^es of color 
signals. 

In conventional color printers, color copiers, etc., color 
conversion processing is performed so as to conform to the 
color reproduction characteristics of a subject recording 
device by restricting input colors. For example, in a color 
copier which incorporates an input device, a print output is 
produced from a particular input document and color con- 
version {H^ocessing from input coIch- signals to recording 
color signals is performed so that the print output color 
coincides with the document color. On the other hand, in a 
color printer, a color conversion process from iaput coIot 
signals to recording color signals is set with an assumption 
(restriction) that certain representative signals are input. In 
general, the representative input signals are NTSC RGB 
television signals. The color coincidence between a display 
and a print output is attained by properly setting a conver- 
sion process from the NTSC RCT signals to recording 
signals of cyan, magenta, yellow and blade 

However, now, a variety of color input and output media 
are used and color signals are exchanged between those 
media through a network, and color signals are diversified 
accordingly. For exan^)le, this situation is reflected in the 
types of application software for editing color image infor- 
mation. FIG. 2 shows specifications of color expression in 
typical pieces of application software. AH of the following 
color spaces can be used: (1) RGB space, (2) HSL and HSB 
spaces defined by operations of modifying the RGB space, 
and (3) CMYK space using recording colors themselves. In 
gener^, where the final outputs are printing outputs, CMYK 
signals are used which are sent to a plate making scanner for 
printing. 

It is a commonly known case that, even if the same color 
space is used, actual color data are different For example, 
the RGB signals of general color scanners are different from 
the NTSC RGB signals. Further, the RGB signals are 
different among a plurality of color scanners because of 
differences of spectral responses, for instance. Similarly, on 
the CMYK space, even if the same CMYK signals are used, 
different sets of colorants produce different print colors. That 
is. other than the color space, there exists an indicat<H^ of 
whether the color signals depend on devices. The "device- 
independent** signals mean signals which are conveitible to 
signals on a colorimetric color coordinate space (e.g., CIE 
XYZ, L*a*b* and L*u*v*) according to known definitive 
equations. The NTSC RGB signals are device-ind^ndent 
signals. Conversely, the **device-dq)endenf * signals are sig- 
nals which are set assuming characteristics of a particular 
device. The CMYK signals and the RGB signals of color 
scanners are device-dependent signals. To process device- 
dependent signals with another type of device, it is necessary 
to describe some corresponding relationship between the 
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device-dependent signals and device-independent signals. 
Exan^les of those relationships are shown in FIG. 2 in the 
column of color matching, which gives color coordinates for 
plural points of CMYK signals. As shown in FIG. 2, there 
5 exist a plurality of color matches in association with the 
kinds of printing inks, etc 

Even now, there has not been proposed a color conversion 
process which can process a number of kinds of input color 
signals independentiy of the kinds to provide f aithfiil repro- 
duction. One method of realizing such a process by use of 
approximation is such that in a known matrix-type color 
conversion process, plural sets of conversion coefficients are 
prepared for different kinds of input color signals and 
switched in accordance with the kind of input color signals. 
However, this method cannot provide sufficient color repro- 
duction accuracy because of nonlinearity of recording 
devices, and cannot extend the conversion in a simple 
manno: for input color signals of four colors sudj as CMYK 
signals. 

A direct look-up table type color conversion method is 
20 known as a metiiod of providing more faithful reproduction. 
However, to apply this method to a number of kinds of input 
color signals, conversion tables of the number of kinds of 
input color signals need to be stored, which increases the 
memory cost Further, like the above matrix type conversion 
25 method, in the case of input color signals of four colors such 
as CMYK signals, the memory size and the size of inter- 
polation operation become so large as to disable simple 
extension of the conversion. 

SUMMARY OF THE INVENTION 

30 

An object of the invention is to provide a color conversion 
processing metiiod and apparatus which can process plural 
kinds of input color signals independentiy of the kinds to 
provide faithftil reproduction, and which, in particular, can 
accommodate input color signals of four colors such as 
CMYK signals as well as input color signals of three colors 
such as RGB signals and signals modified tiierefrom, to 
provide faithful reproduction. 
Another object of the invention is to provide a color image 
^ processing method and apparatus which can perform correct 
color reproduction even with a high UCR (under color 
removal) ratio to thereby in^rove gray balance of photo- 
graphic images and quality of black characters. 

A further object of the invention is to provide a color 
image processing method and apparatus which generates 
color conversion coefficients in a self-multiplying manner 
even for iiq)ut color signals whose conversion relationship 
with device-independent signals (on a colorimetric color 
coordinate space) has not been defined by learning the 
conversion relationship based on color matc^g data asso- 
ciated with the input color signals. 

A still further object of the invention is to provide a 
high-speed color image processing method and apparatus 
which attains the above objects with a smaller size circuit 
55 configuration by performing part or all of op^ations using 
a combination of a plurality of nonlinear operation units. 

According to the invention, a color image processing 
apparatus comprises: 
first converting means for determining conversion char- 
60 acteristics based on a relationship between input color 
signals and uniform color signals on a uniform color 
space, and for converting die input color signals to the 
three uniform color signals, the input color signals 
being of a kind that is one of plural, different kinds; and 
65 second converting means for converting the three uniform 
color signals to image recording signals of four colors 
including black. 
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With the above constitution, the first converting means 
converts the input color signals of a kind that is one of plural, 
different kinds received from a color image input device, 
color image generation device, etc. to the three color signals 
on the iso-perceptive, uniform color space, for instance, to 5 
1976 QDE L*a*b* signals. As shown in the Japanese Indus- 
trial Standards (JIS) Handbook *'Shikisai (Color)-1992", 
page 27, row #2065, **unifcffm color space" is a color space 
in which the aim is for color differences that are perceived 
to be of equal magnitude to correspond to equal distances in 
the space. CIE detennined the 1976 CIE L*a*b* color space 
to be one of the uniform color spaces, as shown at row #2068 
on the same page. It uses the following three-dimensional 
rectangular coordinates: 

L* = 116 ^ -y^ ^ - 16 > 0.008856 
I 1 

''•=^[(^)'-(-^)']-i->°«^56 20 

25 

By performing the conversion (color correction, black 
addition, under color removal, etc.) to the recording signals 
using the above color signals, the process well matches the 
human perception and can be generalized so as not to depend 
on the characteristics of the image input device. To accom- 
modate plural kinds of color signals (see FIG. 2), the 
conv^sion characteristics are defined in advance for the 
respective kinds of color signals and stored in a memory 
means. An input judgment means judges the kind of input 
color signals, and the corresponding conversion character- 
istics are read from the memory means and stored in a 35 
nonlinear conversion drcuiL For the input color signals 
whose conversion relationship with the uniform color space 
has not been defined, the conversion coefficients are auto- 
matically generated by self-learning (sequential 
multiplication) based on a plurality of reference data that are 40 
received prior to the input of the color signals. ITiis consti- 
tution enables the color conversion apparatus to accommo- 
date not only the preset plural kinds of color signals but also 
color signals of future color image devices. Although the 
above advantages can be secured with any types of second 45 
converting means which convert the three color signals on 
the uniform color space to the image recording signals of 
four colors including black, the following advantages can 
further been obtained if an UCR ratio obtained from a 
chroma signal is added as another input of the conversion, 50 
to provide a 4-input/4-ou^ut configuration. 

In the second converting means, the chroma signal C* is 
generated based on the chromaticity signals acoH'ding to its 
definition {{{2i*fM}y*fY^ for the L*a*b* signals), and the 
UCR ratio is determined according to the function that has 55 
been preliminarily set in an adjustable manner. In general, 
the UCR ratio should be set at 0 in a middle chroma range 
where memory colors such as a skin color, grass green and 
sky blue are located, because in that range the inclusion of 
black likely causes a rough image. On the other hand, to 60 
prevent a gray portion from being colored because of 
instability of a recording device, a gray portion needs to be 
reproduced singly by black (the UCR ratio is 1). Considering 
the above, in general, the UCR ratio function is so set as to 
decrease monotonically with the increase of the chroma. 65 

Further, it is necessary to change the UCR ratio with the 
kind of input image. For example, the input image is a 
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precise still life, the texture can be improved by increasing 
the UCR ratio over the entire image. On the other hand, for 
an image including a human as the main feature, such as a 
portrait; it is iibpdrtant to suppress roughness by decreasing 
the UCR ratio. Therefore, the UCR ratio should be set not in 
a fixed manner but in an adjustable manner. The number of 
adjusting parameters is limited to simplify the adjustment. 

Then, in the second converting means, the color output 
signals of cyan, magenta, yellow and black are determined 
from the U(2R ratio and the three uniform color signals (e.g., 
L*a*b* signals). Since this Operation is a four-input/four- 
ou^ut operation, the output color signals are uniquely 
determined. Therefore, the four output color signals satisfy 
faithful reproduction in a colorimetric sense with respect to 
the input color, and the invention is free from the problem 
of the conventional apparatus that the black addition and 
under color removal after the determination of three color 
output signals may prevent faithful reproduction depending 
on the color allocation. Further, since the four color output 
signals are output in a parallel manner, the apparatus of the 
invention can be practiced with a tandem-type recording 
device which records an image of the four color signals in 
a parallel manner (the ink jet type and electrophotographic 
type are presently available). 

In summary, the invention provides the color conversion 
process which can accommodate plural, different kinds of 
input color signals. In particular, with the constitution which 
can even accommodate, by self-learning, input color signals 
whose conversion relationships with a colorimetric color 
coordinate system are not defined, it becomes possible to 
connect to various color image devices that are or will be put 
into practice in a wide range of technical fields, to thereby 
enable desired color reproduction required by various color 
image devices. With the constitution which enables the UCR 
adjustment for image quality improvements (e.g., iiiq)rove- 
ment of texture, stabilization of gray reproduction and 
reduction of graininess of memory colors) taking into 
account the diaractoistics of a recording device, it becomes 
possible to improve the output image quality itself as well as 
assure faithful color reproduction. By virtue of the use of 
three iso-perceptive color signals on a uniform color space, 
every processing step is constructed to be device- 
independent and is performed using iso-perceptive 
lightness/chromatidty separation signals that well match the 
human perception. Therefore, the invention can be applied 
to a variety of image recording devices irrespective of their 
types and necessary adjustments are performed in a manner 
compatible with the human perception. 

BRIEF DESCRCPTION OF THE DRAWINGS 

FIG. 1 is a block diagram showing the entire constitution 
of a color image processing apparatus according to an 
embodiment of the present invention; 

FIG. 2 is a table showing various kinds of color image 
signals used in application software of workstations; 

FIGS. 3 and 4 are graphs showing functions to detennine 
an UCR ratio; 

HG. 5 is a block diagram showing constitution of a 
nonlinear operation unit used in a nonlinear conversion 
circuit; 

FIGS. 6 and 7 are circuit diagrams showing analog 
circuits used in the nonlinear operation unit; 

FIG. 8 shows constitution of a nonlinear operation net- 
work as a central portion of the nonlinear conversion circuit; 

FIG. 9 shows a specific hardware configuration of the 
nonlinear operation network of FIG. 8; 
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FIGS. 10(o) and lC{fc) show a current differeace to signals. The parameter C*2 serves to limit the use of black, 

voltage conversion circuit used in the network of FIG. 9; and is determined considering a chroma distribution of a 

FIGS, ll(fl) and ll(fe) show a threshold circuit used in tiie memq^ color such _as^ the human skin color. This is to 

network of FIG. 9; prevent a case where black is used to rq)roduce a human 

FIG.12isablockdiagramshowingthecntireconstitution ^ skin color and some graininess is caused. Based on the 

of a nonlinear conversion circuit 4; considerations, in the mvenhon, the default param- 

cters are set as follows* 

FIG. 13 is a block diagram showing the entire constitution 

of a nonlinear conversion circuit 7; c*i=lo 

FIG. 14 is a flowchart showing a procedure executed by lo -i 
the nonlinear conversion circuit 7; and 

FIG. 15 is a flowchart showing a procedure executed by c*2=30 
the nonlinear conversion circuit 4. 

DESCRIPnON OF THE PREFERRED the invention, since the UCR adjusting parameters are 

EMBODIMENTS determined only from two coordinate points , they can easily 

Embodiments of the present invention are described here- adjusted only by changing the two points independently 

inafter with reference to the accompanying drawings. witiiin the ranges O^Ak^l and O^C*. In general, this 

FIG. 1 shows the constitution of a color image processing ^<^i^^^^^^ performed in link with such adjusting mecha- 

apparatus according to an embodiment of the invention. ""''"^J'^ density/color adjustoient and a sharpness 

Input image signals are assumed to be signals of appHcation f dJ"™^, and is specifically effective m adjusting the 

programs of color workstations and personal computers as texture of reproduced miages m accordance with the kmd of 

shown in FIG. 2. The input signals consist of color image a oocumen 

signals D,-D, of four colors or less, data D^ indicating^e ^ ^^^^ ^ ^^^"^yf ^1^^ ^J' 

kind of color data, and reference data indicating a type is a polygonal Ime function as shown m FIG. 3. In this 

corresponding relationship with devic^^inde^ndent signals, '''^'''^^ paramet^s (C\, AkJ, (C*„ Ak^ 

ThedataD^^anddiercference dataT^ are inputto an input « expressed as follows: 

judgment means 1 prior to the input of the color image ^^^^ foj c*<c*j 
signals Di-D4. The input judgment means 1 conc^ares tiie 

data Dflg with a preset Hst of input signals. If a coincident aHC'^*^XAkr~Ak^yiC*2'C*,y*Ak^ for c\^c^c*^ 

number is found in the list, a content of a weight memory 3 ^^^^ c*2^c* (4) 

having that number as its address is set in a nonlinear ^ 

conversion circuit 4. If no coincident number is found, the The second type is a monotonic, saturation-type continu- 

input judgment means 1 forwards the reference data T^ to ous function as shown by a thick line in FIG. 4. In this case, 
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a learning means 2 to learn weight coefficients for nonlinear using the adjusting parameters (C*i, Akj), (C*^, Ak^ the 

conversion (described later). The data D^,^ and the weight UCR ratio a is expressed as foEows: 
coefficients are newly registered in the weight memory 3, 

and the weight coefficients are set in the nonHnear conver- ct^m.-Ak^H-^ h{iiU2XC^yb}y2 (5) 

sion circuit 4, ^ ^^^^ 

The nonlinear conversion circuit 4 converts the color a=(C*i+C*2)/2 

image signals D1-D4 of four colors or less to "iso- b=(C* -C* V2 

perceptive" (a distance between two points on a a^rdinate ^h^ ^CR ratio a is fixed at 1 when Eq. (5) takes a value 

system is^oportional to a percepmal o^lor difference) ^ ^j^^^ 1 and at 0 when it takes a negative value, 

hghtness/chromaticity «^ in this ,5 ^^^^^ ^ ^ ^^^^^^^ ^^^^^ 

embodmient, the 1976 OE L*a*b*, which are of such tution of a nonlinear conversion circuit 7 that is provided at 

signals, are employed as output signals of the nonbnear ^^e next stage. TTie first type is suitable for a dir^ look-up 

conversion circuit 4. ^^j^ conversion circuit This is so because the 

Of the {L*. a*, b*} signals ou^ut from the nonlinear direct look-up table type conversion is a polygonalline type 

conversion circuit 4, the {a*, b*} signals are input to a 50 conversion on a color space in which conversion outputs for 

chroma determination means 5, which calculates a chroma representative points on the color space are stored in the 

signal C* according to the definition fonn of a table and outputs for arbitrary inputs are deter- 
mined by linear interpolation on representative points in the 

Ci^(a*)2-Kfc*)2}»^ (1) vidnity of the inputs. 

55 On the other hand, the second type is suitable for the 

and outputs the result nonlinear conversion circuit 7 (described later) of the 

The chroma signal C* is input to an UCR ratio calculation invention, because the nonlinear conversion circuit 7 is a 

means 6, which detamines an UCR ratio a by an operation combination of conversion elements which exhibit continu- 

using parameters supplied externally. As shown in FIG. 3, ous and differentially continuous characteristics. In this case, 

the parameters are given as two points (C*i, Akj), (C*2» 60 it is desired ttiat a ftinction for the UCR ratio be defined as 

Aks) on a C*-a coordinate system A relationship Ak^ >Ak2 also being continuous and differentially continuous, 

holds in general and, to reproduce gray singly by blade, it is Although in the embodiment Eq. (4) is used in the UCR 

desired that Ak^ be equal to 1 . ratio calculation means 6 for the above reason, the invention 

The parameter C*i is set considering the gray reading is not limited to Eq. (4) but may employ any proper function 

accuracy in processing the input signals. In particular, the 65 types. 

parameter C*i is set based on a C* error when a black thin The UCR ratio a output from the UCR ratio calculating 

line of an image is read and converted to {L*, a*, b*} means 6 and the {L*, a*, b*} signals output from the 
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nonlinear conversion means 4 are input to the nonlinear processing speed than the conventional circuit simulating a 

conversion circuit 7, which produces four output color cell of a neural network. Therefore, this embodiment is 

signals of cyan, magenta, yellow and black. Being a 4-input/ directed to the case of implementing the nonlinear operation 

4-output conversion,' this conversion is performed uniquely. unit as an" analog circuit" 

In the above steps, the input image signals, which are based 5 In the following, the analog-type implementation of the 

on one of various color definitions, are converted to ou^ut nonlinear operation unit of the nonlinear conversion circuits 

signals of four colors of the recording system while the 4 and 7 is described in detail. The analog circuit includes 

colorimetric reproduction capability is maintained. In the differential amplifiers each consisting of a pair of bipolar 

above process, the black signal is controlled to provide a transistors whose first terminals (emitters) are connected to 

highest output image quality. lO eadi other. A voltage difference proportional to an input is 

In the following, the constitution of the nonlinear con- applied between the second tominals (bases) of the pair of 

version circuits 4 and 7 of this embodiment is described in bipolar transistors that constitute each differential amplifier, 

detail. Basically the nonlinear conversion circuits 4 and 7 and a current proportional to a weight for the multiplication 

can have the same constitution, and the following descrip- are suitably supplied to the first terminals (emitters). An 

tion is directed to such a case. But the invention is not i5 output of die differential amplifier is obtained at die third 

limited to such a case. This nonlinear convasion circuit terminals (collectors) as a current difference, 

under discussion is disclosed in Japanese Patent Application FIG. 6 shows a specific example in which bipolar tran- 

No. HeL 5-85157 filed by the present assignee and entitled sistors are used. A difference between collector currents I^i 

'•Nonlinear Operation Unit and Information Processing and 1^7 of the respective transistors is 

Apparams Using the Same." 20 

Each of the nonlinear conversion circuits 4 and 7 is ^ci-^c2=^£taa /({(Vai-VKiyzVr}. (8) 

constituted of a plurality of nonlinear operation units (see . , , . , i^^.^..^ fi.^M^^n t^ni, « tr^ 

xTrr- c\ «^ f« ^*u^ Tk. .^t,«.af^/^« That is, m this cu-cuit, the logistic function tanh is applied to 

FIG. 5) connected to each other. The nonlmear operation , . ' Aitf^^^^Z, \t \r ♦i,oT«.,iu 

i x-r^ a- ■ . X 1- -L- the input voltage difference and the result is 

unit of HG 5 consists of nonbnear operation portio.^ "^^ ^ 

51«-51«eachforapplymg a nonlmear funcUong(iv) to e^^^ 25 difference I^;.]^. This circuit tas Aaracteristics to provide 

of one or moreinputs u,,ii,ult^lication portions 52a^2« for above-desafted function of applying a nonline^ func- 

mu^tplying the respective outputs of the nonlmear operatton multiplying the iuldpUcation result by 

portions 51a~Sln by weights w^,., and an addition portion 53 f^. f j & f j 

for adding up the outputs of the multiplication portions ^ weign . *u 

1* ~Z^^ , * < ^ 1.. In the case of mcludine positive and negative signs, the 

SZa-Sln and further adding a threshold t, to the resultmg 30 ui m^iuuing pvaiuv^ auu u ^o, 

*t- 1. ij u A ♦ • *u AA'^ noulincar operation umt has a configuration as shown m 

sum^ The tlueshold may be 0 to smiphfy flie addition piG. 7 in wMch the circuit of HG. 6 is employed as the basic 

portion S3. An output u, of the nonhnear operation unit i is ^„^„„^„t^ ^^j, (^iiritt^) of transistors 

express as (element-1 and element-2) of component-1 are connected to 

fS'k s ^^^^ ^® terminals (emitters) of transistors 

Hi - 2 wjig(uD + Ti I > 35 (gigjj^ent.i and element-2) of coraponent-2 are connected to 

each other to form respective differential amplifiers of 

In the neural network theory, usuaUy an ou^ut of each component-1 and component-Z The second terminals 

nerve i is expressed as (bases) of the transistor (element-1) of component-l and the 

xr=«(Ui) (6) ^ transistor (element-2) of component-2 are connected to each 

where u, is an internal potential of the neuron L The internal other to form an input terminal for V,^ The second 

potential u, is expressed as terminals (bases) of the transistor (element-2) of 

conq)onent-l and the transistor (element-1) of component-2 

u -^w'ix +Tf (7) connected to each other to form an input terminal for 

"* j ' Wjf^i (This terminal may be grounded). Fimher, the third 

^ , _ . ^ f ^ terminals (collectors) of the transistor (element-1) of 

where x, is an output of a neuron, w,, is strengtii of .g^^ ^nd the transistor (element-1) of component-2 

connection from the neuron j to Uie neuron i and is a areTonnected to each other to form a first output termmal for 

threshold of the neuron cell l Therefore, a convenUona^ ^^^^ (coUectors) of the transistor 

cncmtconfigurationthatsimulatesaceUof a^^ (element-2) of component-1 and the transistor (element.2) 

performs calculations accordmg to Eqs (6) and (7). The 50 ^fconiponent-2are^nnected to each odier to form a second 

curcuit mcludes a multiplication portion for mult^lymg the output terminal for 

inputs X, by fte respective w«ghts w,, and an addition ^.^ con^^tion. when the voltage difference 

that is proportional to the input and a current 

portion, and the nonlmear ft«ncUon g(u..) is apphed to die ^1,^^^^ ^^fi^ proportional to the weight are 

resultmg sum to obtam the output of the cu-cmt 55 ^ . ^„ ^L^^™.;* o f..^^*;^^ io 

^ ^. V suppued to the arcuit, a bounded, monotomc function is 

Whereas the nonlmear (?>eration unit of the nonlinear "^^^ ^ ^ ^ that is 

conversion circuits 4 and 7 of th^ embodiment has the ^^^^ „f the funcSon iSSh and the 

c^cuit configuration different than the conventional circmt ^^^^ ^^^^^^ ^^^^^ ^ ^^^^ ^ 

of simulatmg a cell of a neural network, when a plurahty of »• vi- 

nonlinear operation units are combined to constitute a 60 W-/w72=<'iri-42)tan^i{(V„i-v^y2Vr} (9) 
network, they operate equivalentiy to the conventional cir- 
cuits for the entire neural network. The above-described "While the above nonlinear operation unit of the nonlinear 
configuration of the nonlinear operation unit can be imple- conversion circuits 4 and 7 of the invention is constituted of 
mented as either a digital circuit or analog circuit In bipolar transistors, characteristics including a bounded, 
particular, the analog nonlinear operation unit has smaller 65 monotonic function and multiplication can be obtained by 
errors due to a temperature variation and circuit configura- using otha* nonlinear amplifying elements having three or 
tion and is simpler in circuit constitution and higher in more tenninals, such as FETs generally operating as bal- 
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anced modulators, electron tubes having a remote cutoff in the nonlinear conversion circuits 4 and 7. For exai]:q>le, 

characteristic and electron tubes having a variable-n char- the back propagation method, which is known in the neural 

acteristic. network theory, can be used as the optunizing method. In the 

FIGS. 8 and 9 show an embodiment of a central conver- back propagation method, desired outputs for inputs are 

sion portion of the nonlinear convffsion circuits 4 and 7, in 5 given in advance as teacher signals and differences between 

which the nonlinear operation units are arranged in a net- ^^^^l outputs and tfie teacher signals are convffted by using 

work. In the case of the nonlinear conversion circuit 4, the ^ catain function to an energy. The weights and thresholds 

inputs to the network are the color image signals sent from are repeatedly converted until tht energy decreases for a 

a workstation etc. and then analog-converted. In the case of P^«let«mined set of outputs and reaches 0 or is satiHated 

the nonlinear conversion circuit ^ the inputs to the network lo ^^^ce the energy functon mdudes the weights and tfaresh- 

are the UCR ratio a from the UCR ratio calculation means ^ll!^ J^^^n^P ^^^^^^ 

^ . , ^ J rr * * • 1 T *!. nation or continuous functions, multiplications and 

6 and the analog-converted {L*, a* b*} signals. In the c^e ^^^^^ ^ ^ diffeJentiated by the 
of die nonhnear conversion circuit 4, the four outputs are the ^^^^^ thresholds (variables). Using the differentiated 
{L*, a*, b*} signals and a dummy signal. In the case of the functions, the energy function can be deaeased by changing 
nonlinear conva-sion circuit 7, the outputs are four analog 15 the weights and thresholds so that the energy function 
color signals of cyan, magenta, yellow and black. The deaeases 

network includes two intermediate layers and four interme- pi^st the method of setting the weights and the thresholds 

diate cells fw each layer. FIG. 8 shows the constitution of the conversion from tiie {L*, a*, b*} signals to the 

the network, in which numeral 81 denotes each nonlinear ^MYK signals using the above tedinique in tiie nonlinear 

convenion unit of HG. 7 and symbol 82 denotes a connec- 20 conversion circuit 7 is described, and then the method of 

tion between the units. HG. 9 shows a circuit configuration netting the weights and the thresholds for the conversion 

to inclement the network of HG. 8. In FIG, 9, unit 91 from the input color signals to the {L*, a*, b*} signals using 

reia-escnts the nonlinear operation unit of FIG. 7, unit 92 ^bove technique in the nonlinear conversion circuit 4 is 

represents a current difference to voltage conversion circuit described. 

shown in HGS. 10(a) and lUKfe). and unit 93 represents a 25 Referring to HG. 14, we explain tiie procedure of opti- 

threshold circuit shown in HGS. Ilia) and n{b). This mizing the weights and thresholds of tiie nonlinear conver- 

network as a whole can perfoim a desired input/ou^ut 5^0^ circait 7 of tiiis embodiment, 

conversion that is nonlinear and continuous by optimize in gj^p j 

advance the weights of the nonlinear operation units and the Conversion pairs between C,M,y,K and L*a*b* are pre- 

thresholds by a method described later. 30 pa^ed in this step. 

Since the central convenion portion of the nonlinear Known four color recoa-ding signals (C,M,Y,K) are input 

conversion circuits 4 and 7 of the invention is a combination to a subject recording device to produce an actual color print 

of the simple nonlinear operation units as described above, ^^y^^ ^he color of the colorprinted sample is measured by 

it can presents high processing speed and can produce a ^ colorimeter on tihe market or the input device of the 

pluraUty of outputs in a paraUel manner with a small-size 35 invention (a corresponding relationship with tiie L*a*b* 

circuit configuration. It can provide much higher conversion signals is known) to produce L*a*b* signals. N (=F^, for 

accuracy tiian the conventional matrix-type color conversion instance) input/ou^ut pairs of tiie above conversion are 

by virtue of an increased degree of freedom of parameters. prepared considering tiie nonlinearity of tiie recording 

Compared with the polygonal line approximation type con- device, 

version (called the direct look-up table type conversion) on 40 g^gp 2 

a color space in which conversion ou^ts for representative this step, learning is performed on flie conversion from 

points on tfie colw space are stored as a table and output c,M,Y4C to L*a*b* using OE L*a*b* AE as tiie energy 

values for arbitrary inputs are determined by linear int^po- function. 

lation on representative points in tiie vicinity of tiie inputs. Learning is performed according to the back propagation 

the conversion of titis embodiment is simpler in circuit 45 metiiod using tiie C,M,Y,K signals and the measured L*a*b* 

constitution and superior in tiiat tiie continuity and tiie signals of tiie N conversion pairs prepared in Step 1 as ttie 

differential continuity are assured in tiie input/ou^ut con- -^^^^ ^nd ou^ut teacher signals, respectively. Using OE 

version. L*a*b* AE, tiie energy function is defined as foUows: 

Usmg the above mput/output conversion portion as the ^ 

central conversion portion of tiie nonlinear conversion dr- so B=^(L^L*fMfl*^*f-^^y^ (lO) 

cuits 4 and 7, the entire nonlinear conversion circuit 4 and where L**, a*' and b*' are prediction output values 

7 are constructed as shown in HGS. 12 and 13, respectively. (nonlinear). 
In the nonlinear conversion circuits 4 or 7, a D/A conversion Step 3 

and nonlinear range conversion portion 121 or 131 and an In this step, learning is performed on the conversion from 

A/D conversion and nonlinear range conversion portion 123 55 L*a*b* to Kmax using a subset of the conversion pairs 

or 133 are provided before and after nonlinear networks 122 between C,M,Y,K and L*a*b*. 

or 132 as described above (see FIG. 8), respectively. Thus, A subset in which at least one of CM and Y is 0 is 
the nonlinear conversion circuit 4 outputs the {L*, a*, b*} extracted from the conversion pairs between C,M,Y,K and 
signals, and the nonlinear conversion circuit 7 supplies the L*a*b* prepared in Step 1, Learning is performed for the 
four color recording signals to a recording device. Where the 60 subset according to tiie bade propagation method using die 
recording device has an analog pulse width modulation L*a*b* signals as the input teacher signals and the K signal 
means such as a laser, the A/D conversion and nonlinear as tiie output teacher signal Since all the K signals of the 
range conversion portion 133 is not always necessary and subset are for the reproduction of 100% UCR ratio, this 
may be omitted. conversion provides die maximum value Kmax of tiie set- 
Next, a method of setting the weights and thresholds of 65 table K signal while conserving tiie given L*a*b* signal 
the nonlinear conversion circuits 4 and 7 is described. colorimetrically. The energy function E is defined as fol- 
Basically, tiie same weight setting metiiod can be employed lows: 
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£={r(Xmax-Amax')^}"3 (11) 

where Kinax' is a prediction output value. 

Alternatively, L*a*b* and L*'a*'b*' are respectively cal- 
culated from CJvl,Y,Kinax and C^,Y4Cmax' using the 
conversion obtained in Step 2, the energy function E is 
defined as a distance in a color difference space such that: 

E=l{{L*-L*fM.a*-c*fM.b*-b*f}^'^ (12) 

Step 4 

In this step, learning is performed on the conversion from 
L*a*b*a to C J4,Y,K by calculating the UCR ratio a based 
on Kmax of Step 3 and K of Step 1. 

First, Kmax is obtained for L*a*b* using the optimum 
conversion obtained in Step 3. On the other hand, by 
referring to the K signal of C,M,YiC that corresponds to 
L*a*b*, the UCR ratio a is obtained as follows: 

ct=/:?jrinax (13) 

New conversion pairs between L*a*b*a and C,M,Y.K arc 
obtained by subjecting all of the N conversion pairs of Step 
1 to the above operation. 
Steps 

In this step, learning is performed based on conversion 
pairs from L*a*b*a to C J4,YJC and the resulting weights 
and thresholds are set as optimum values of the nonlinear 
conversion circuit 7. 

The energy function E is defined as follows: 

E=X{(C-CfM,M-MfMY~YfHK-Kf}^'^ (14) 

where L', M', Y and K are prediction output values 

Altanatively, L*a*b* and L**a*'b*' are respectively cal- 
culated from CJ4,Y,Kmax and C^,YJCmax' using the 
conversion obtained in Step 2, the energy function E is 
defined as a distance in a color difference space such that: 

B=Z{iL*-L*'f-Ha^-a*f-Hb^*fy^ (15) 

Learning is performed according to the back propagation 
method using L*a*b*a as the input teacher signals and 
C^,Y,K as the output teacher signals. If the energy function 
of Eq. (15) is employed, the optimum weights and thresh- 
olds which minimize the energy function E of Eq. (10) are 
set as optimum values of the nonlinear conversion circuit 7. 
Similarly, the latter may be approximated using Eq. (14). 

The weights and thresholds of the nonlinear conversion 
circuit 7 are detoroined by performing the above steps, and 
the L*a*b* signals are converted to desired color recording 
signals by the apparatus of FIG. 1. The above optimization 
|H-ocess is practiced in a manner depending on the stability 
etc, of a recording device. If the recording device is very 
stable, the above steps may be performed preliminarily and 
the resulting weights and thresholds may be stored as 
characteristic values. On the other hand, if the recording 
device is not stable, part or all of the above learning process 
may be incorporated, as one of its functions, into a color 
copier which is equipped with the color image processing 
apparatus of the invention. For example, the following 
procedure may be employed. In a particular mode of color 
copier, known four color recording signals (C,M,Y,K) are 
stored in a memory of the copia and then output as a test 
print The test print is read by an input device of the copier 
to produce L*a*b* signals. Then, the operations to Step 5 
are executed by software of the copier and the results are 
stOTed in a predetermined memory. With this constitution, a 
variation of the characteristics of the recording device due to 
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environmental variations can be compensated at a proper 
timing, so that color prints can be always produced in a 
stable manner. 

Next, a method of optimizing the weights and thresholds 

5 of the nonlinear conversion circuit 4. With the nonlinear 
conversion circuit 4, the weights and thresholds for conver- 
sion from arbitrary input signals to the {L*, a*, b*} signals 
are set in the weight memory 3. The manner of setting the 
weights and thresholds depends on whether the kind of color 

10 data (D^^) is known. Where it is known, the optimization of 
the wei^ts and tliresholds may be performed on a off-line 
basis and it suffices that only the results of the above- 
described processing according to the back propagation 
method are set in the weight memory 3. In this case, the 

15 results can be obtained by performing a procedure of FIG. 
15 off-line. For example, in the case of color mput signals 
(DIC-approved) whae the color matching is DIG and the 
color space is CMYK (see the application programs of FIG. 
2), l,0{X)-plus printing standard color samples are defined. 

20 Therefore, the process can be effected properly by prelimi- 
narily performing the learning operation using those samples 
as the teacher data and setting learning results in the weight 
memory 3. 

On the other hand, where the kind of color data (D^^) is 

25 not known, the reference data T^, is input to the learning 
means 2 and the weights and thresholds are optimized 
on-line according to the procedure of FIG. 15, which is the 
same as in the case where the kind of color data (Dyj^) is 
known. While the back propagation method can be used as 

30 the optimization method, other known learning methods 
may be employed to provide higher efficiency. In the actual 
process of learning, cumbersome calculations are necessary 
of the above-described energy function is differentiated. 
Therefore, it is a general procedure that learning is per- 

35 formed so as to decrease the energy for each pair of the input 
signal and the teacher signal. In the back propagation 
method, it may be the case that the error takes an extreme 
rather than a minimum. It is Imown that this phenomenon is 
effectively avoided by adding proper noise to the respective 

40 weights and thresholds in the learning process. 

Although the above description is directed to the nonlin- 
ear conversion circuits using the back propagation method, 
any systems based on the neural network theory which 
enable teacher association type learning can be used as the 

45 noniinear conversion circuit of the invention. 

Although the above description is directed to the case 
where plural, different kinds of input color signals are 
converted to image recording signals of a single output 
device, the nonlinear conversion circuit 7 may be so modi- 

50 fied as to accommodate plural, different output devices. That 
is, another weight memory 9 (shown by a dotted line in FIG. 
1) is provided to store information for defining conversions 
from L*a*b*a to Yout>Iout,Cout,Kout of the number of 
output devices to be connected to the apparatus of the 

55 invention. In response to an external signal P,^ to select a 
desired ou^ut device, the information for defining the 
corresponding conversion is read from the weight memory 
9 and set in the nonlinear conversion circuit 7. Thus, it 
becomes possible to select among a plurality of output 

60 devices having different characteristics, for instance, print- 
ers. 

As described above, the invention provides the color 
conversion process which can accommodate plural, different 
kinds of input color signals. In particular, with the consti- 
65 tution which can even acconmiodate, by setf-leaming, input 
color signals whose conversion relationships with a colon- 
metric color coordinate system are not defined, it becomes 
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possible to connect to various color image devices that are 
or will be put into practice in a wide range of technical fields^ 
to thereby enable desired color reproduction required by 
various color-image devices^ 

With the constitution whidi enables the UCR adjustment 
for image quality improvements (e.g., improvement of 
texture, stabilization of gray reproduction and reduction of 
grainiDCss of memory colors) taking into account the char- 
acteristics of a recording device, it becomes possible to 
improve the output image quality itself as well as assure 
faithful color reproduction. 

According to the invention, by virtue of the use of three 
iso-pcrceptive color signals on a unifonn color space, eveiy 
processing step is constructed to be device-independent and 
is performed using iso-perceptive lightness/chromaticity 
separation signals that well match the human percq)tion. 
Therefore, the invention can be applied to a variety of image 
recording devices irrespective of their types and necessary 
adjustments are peifonned in a manner compatible with the 
human perception. 

Further, since the apparatus of the invention includes the 
nonlinear conversion drcuit in the form of a combination of 
simple nonlinear operation units, it can operate at high speed 
and the four color parallel output processing can be realized 
by a small-size circuit configuration. The invention can 
provide much higher conversion accuracy than the conven- 
tional matrix-type color conversion by virtue of an increased 
degree of freedom of parameters. Compared with the 
polygonal line aj^iroximation type conversion (called the 
direct look-up table type conversion) on a color space in 
which conversion ou^uts for representative points on the 
color space are stored as a table and output values foe 
arbitrary inputs are d^ermined by linear interpolation on 
representative points in the vicinity of the inputs, the con- 
version of the invention is superior in that the size of the 
memory of conversion coefficients for plural kinds of input 
color signals is very small, and that the continuity and the 
differential continuity are assured in the input/output con- 
version to prevent quasi-outlines as would occur in rq>ro- 
ducing an image including subtle color gradation in com- 
puter graj^cs etc. 

Having the above advantages, the color image processing 
apparatus of the invention can be applied suitably to a wide 
variety of apparatuses such as a printing scaimer, video 
printer, digital color copier and a color-proof systenL 

What is claimed is: 

1. A color image processing method comprising the steps 

of: 

receiving input color signals; 

determining the type of the received input color signals, 
which type can be one among a plurality of input color 
signal types, each of the plurality of input color signal 
types con^nising a set of color signals used to identify 
color information in a corresponding color space; 

storing in a storing means conversion coefficients for 
converting each of a plurality of input color signal 
types into a uniform color signal type in a uniform color 
space; 

retrieving the conversion coefficients for the determined 
type of the received input color signals from the storing 
means 

converting the received input color signals to three inter- 
mediate color signals of the unifonn color signal type 
in the uniform color space using the retrieved conver- 
sion coefficients; and 

converting the three intermediate color signals of the 
uniform color signal type in the uniform color space to 
image recording signals of four colors including black. 
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2. The method of claim 1, wherein the retrieving step 
includes a step of learning the conversion coefficients for 
converting each of a plurality of types of received input 
color signals for which conversion coefficients are not stored 
in the storing means into the uniform colc^ signal type in the 
uniform color space based on plural sets of teacher signals 
for each of the plurality of types of the received input color 
signals for which conversion coefficients are not stored in 
the storing means. 

3. The method of daim 2, wherein at least part of 
operations of each converting step are performed by a 
combination of functions each comprising: 

applying a nonlinear conversion to a plurality of inputs; 
multiplying results of the nonlinear conversion by respec- 
tive weights; and 
adding up results of (he multiplying step. 

4. The method of claim 1, wherein the step of converting 
the three intermediate color signals in the uniform color 
space includes: 

determining a chroma signal based on the intermediate 
color signals in the uniform color space; 

determining an under color removal ratio based on the 
chroma signal; and 

determining the image recording signals of four colors 
based on the three intennediate color signals in the 
uniform color space and the under color removal ratio. 

5. A color image processing apparatus comprising: 
storage means for storing respective sets of information 

related to convffsion coefficients foi each of a plurality 
of color signal types, each of the color signal types 
con^sing a set of color signals used to identify color 
information in a corresponding color space; 

means for receiving input color signals; 

means for determining the type of the received input color 



means for retrieving from the storage means the respec- 
tive set of information stored in the storage means for 
the determined type of the received input color signals; 

first converting means for converting the received input 
color signals to three intermediate color signals of a 
uniform color signal type in a tmiform color space 
using the retrieved set of information; and 

second converting means for converting the three inter- 
mediate color signals of the uniform color signal type 
in the uniform color space to image recording signals of 
four colors including black. 

6. The apparatus of claim 5, wherein the first converting 
means conqnises: 

nonlinear conversion means for converting the received 
input color signals into the three intermediate color 
signals in the uniform color space, said nonlinear 
conversion means being settable for converting at least 
some color signal types of the plurality of color signal 
types; and 

means for setting the nonlinear conversion means prior to 
input of the input color signals by using a retrieved set 
of information based on expected input color signals. 

7. The apparatus of daim 6, wherein the first converting 
means further con^mses learning means for determining a 
set of information related to conversion coeffidents when no 
set of information for the selected input color signal type is 
stored in the storage means, said learning means performing 
a learning operation in cooperation with the nonlinear con- 
version means based on plural sets of teacher signals, and for 
storing ffie d^ermined set of infommtion in the storage 
means. 
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8. The apparatus of claim 5, wherein at least one of the 
first and second converting means comprises a network 
circuit including a plurality of nonlinear operation units 
connected to each other. 

9. The apparatus of claim 8, wherein each of the nonlinear 
operation units comprises: 

means for applying a nonlinear conversion to a plurality 
of inputs; 

means for multiplying results of the nonlinear conversion 

by respective weights; and 
means for adding up results of the multiplications, and 

further adding a threshold to a sum of the multiplication 

results. 

10. The apparatus of claim 9» wherein a combination of 
the nonlinear conversion applying means and the multiply- 
ing means is formed by an analog circuit, and wherein a unit 
circuit of the analog circuit comprises a differential amplifier 
having a pair of three-terminal amplifying elements having 
respective first terminals connected to each other and sup- 
plied with a current proportional to the weight, respective 
second terminals between which a voltage difference pro- 
portional to the input is applied, and respective third termi- 
nals a difference between currents flowing through which 
terminals serves as an output, 

11. The apparatus of claim 9, wherein a combination of 
the nonlinear conversion applying means and the multiply- 
ing means is formed by an analog circuit, and wherein a unit 
circuit of the analog circuit conqjrises: 

a first differential amplifier having first and second three- 
terminal amplifying elements having respective first 
terminals connected to each other to form a first weight 
terminal; 

a second differential an^)lifier having third and fourth 
three-terminal anc^lifying elements having respective 
first terminals connected to each other to form a second 
weight terminal; 

a first input terminal being a connection of respective 
second terminals of the first and fourth three-terminal 
amplifying elements; 

a second input terminal being a connection of respective 
second terminals of the second and third thrce-tenninal 
an^lifying elements; 

a first ou^ut terminal being a connection of respective 
third terminals of the first and third three-terminal 
amplifying elements; and 

a second output terminal being a connection of respective 
third terminals of the second and fourth three-terminal 
amplifying elements, 

wherein a voltage difference proportional to the input is 
applied between the first and second input terminals, 
and a current difference proportional to the weight is 
applied between the first and second weight terminals, 
so that a difference between currents flowing through 
the first and second output terminals serves as an output 
that is prqx)rtional to a product of a result of applying 
a bounded, monotonic function to the input and the 
positive or negative weight 

12. The apparatus of claim 5, wherein the second con- 
verting means comprises: 



means for determining a chroma signal based on the three 
intermediate color signals of the uniform color type in 
the unfform color space; 
means for determining an under color removal ratio based 
3 on the chroma signal; and 

means for determining the image recording signals of four 
colors based on the three intermediate color signals and 
the under color removal ratio. 
13. The apparatus of claim 12, wherein the under color 
removal ratio determining means comprises: 
means for receiving adjusting parameters (C*i, Akj) and 

(C*2, Akj); and 
means for determining the under color removal ratio a 
according to a function 
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OKAJk, for C*<C*, 

a=(C*-C»,x^-^Jtiy(C*2-^*iHAJti for c*,sc*<c*2 
a=;AJfc2 for C*2^C* 

where C* is the chroma signal. 

14. The apparatus of claim 12, wherein the under color 
removal ratio determining means comprises: 

means for receiving adjusting parameters (C*i, Ak^) and 

(C*2, Aka); and 
means for determining the under color removal ratio a 

according to a function 

a=^-Ki«,-AJt2)[l-taa h{{T^2XC^yb}y2 

fr=(c*2+c*,y2 

where C* is the chroma signal and a is fixed at I when the 
above equation takes a value larger than 1 and at 0 when the 
above equation takes a negative value. 

15. The apparatus of claim 12, wherein the first converting 
means comprises nonlinear conversion means for converting 
the input color signals into the three intermediate color 
signals of the uniform color type in the uniform color space; 
and the second converting means comprises: 

second storage means for storing respective sets of infor- 
mation for converting the three intermediate color 
signals of the umform color type in the uniform color 
space to any of a plurality of image recording signal 
types, each of the image recording signal types corre- 
sponding to image recording signals used to identify 
recording color information; 

second nonlinear conversion means for converting the 
three intermediate color signals of the uniform color 
type in the umform color space into image recording 
signals of an image recording signal type for a corre- 
sponding recording device; and 

means for setting the second nonlinear conversion means 
prior to input of the input color signals by reading a set 
of the information stored in the second storage means, 
which set of information corresponds to the image 
recording signal type for the corresponding recording 
device. 



60 



08/13/2004, EAST Version: 1.4.1 



